Papers with multi-turn tasks
Direct Multi-Turn Preference Optimization for Language Agents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Extensive experiments on three multi-turn agent task datasets confirm the effectiveness and superiority of the DMPO loss function. |
| Approach: | They propose a novel loss function for multi-turn agent tasks that replaces the policy constraint with the state-action occupancy measure constraint and adds length normalization to the Bradley-Terry model. |
| Outcome: | Experiments on three multi-turn agent task datasets confirm the effectiveness and superiority of the proposed loss function. |
Turn-PPO: Turn-Level Advantage Estimation with PPO for Improved Multi-Turn RL in Agentic LLMs (2026.findings-eacl)
Copied to clipboard
| Challenge: | Reinforcement learning (RL) has re-emerged as a natural approach for training interactive LLM agents in real-world environments. |
| Approach: | They propose a variant that operates on a turn-level MDP formulation, instead of the commonly used token-level one. |
| Outcome: | The proposed method is more robust than the widely used GRPO algorithm and more efficient than token-level MDPs. |
The Confidence Dichotomy: Analyzing and Mitigating Miscalibration in Tool-Use Agents (2026.acl-long)
Copied to clipboard
| Challenge: | a fundamental pillar of trustworthiness is calibration, which refers to an agent’s ability to express confidence that reliably reflects its actual performance. |
| Approach: | They propose a reinforcement learning framework that jointly optimizes task accuracy and calibration, supported by a holistic benchmark of reward designs. |
| Outcome: | The proposed framework improves calibration across tool types and shows that trained agents achieve superior calibration and exhibit robust generalization from local training environments to noisy web settings and to distinct domains such as mathematical reasoning. |
U-Fold: Dynamic Intent-Aware Context Folding for User-Centric Agents (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing context-folding methods are designed for single-query or single-intent scenarios. |
| Approach: | They propose a dynamic context-folding framework tailored to user-centric tasks that preserves fine-grained information through dynamic context folding. |
| Outcome: | The proposed framework outperforms ReAct and previous folding frameworks on long, noisy tasks. |
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks. |
| Approach: | They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges. |
| Outcome: | The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization. |
EvoRoute: Experience-Driven Self-Routing LLM Agent Systems (2026.acl-long)
Copied to clipboard
| Challenge: | EvoRoute is a self-evolving model routing paradigm that transcends static, pre-defined model assignments. |
| Approach: | They propose a model routing paradigm that transcends static, pre-defined model assignments. |
| Outcome: | Experiments on GAIA and BrowseComp+ show that EvoRoute reduces execution cost and latency by over 70%. |